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Abstract 

In the last decade a huge amount of articles has been published 
studying pattern avoidance on permutations. From the point of view 
of enumeration, typically one tries to count permutations avoiding cer- 
tain patterns according to their lengths. Here we tackle the problem 
of refining this enumeration by considering the statistics "first /last en- 
try" . We give complete results for every generalized patterns of type 
(1, 2) or (2, 1) as well as for some cases of permutations avoiding a pair 
of generalized patterns of the above types. 

1 Introduction 

Let 7r G S n and r G Sk, where St denotes the symmetric group on 
[t] = {1,2, ... ,t}. We say that tt avoids r if there are no subsequences 
iTi-^TT^ . . . m k with 1 < i\ < %2 < ■ ■ ■ < 2fc < n which are order-isomorphic 
to t, that is having the entries 7Tj . in the same relative order of the entries 
of r. The permutation r is called a (classical) pattern. We denote the set 
of all r-avoiding permutations of S n with S n (r). In [T], generalized patterns 
were introduced to study the Mahonian statistics on permutations. They are 
obtained by inserting one or more dashes among the entries of r. A pattern 
r = n — T2 — . . . — Tfc with k — 1 dashes is called of type (|ri|, \t2\, ■ ■ ■ \Tk\), 
where |r| is the length of r. For instance, r = 13 — 26 — 574 is a pattern 
of type (2, 2, 3). A classical pattern of length k can be seen as a pattern of 
type (1, 1, ... , 1), assuming that a dash is inserted, but not showed, between 

k 

each pair of consecutive elements of the classical pattern. If r G 5*3, then 
generalized patterns deriving from r are of type (1,2) or (2,1) according 
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to the number of elements preceding and following the dash and they are 
collected in the set 

V = {1 - 23, 12 - 3, 1 - 32, 13 - 2, 3 - 12, 31 - 2, 2 - 13, 21 - 3, 
2 - 31,23 - 1,3- 21,32 - 1}. 

A permutation ir contains a generalized pattern p £ V if adjacent elements in 
p are also adjacent in ir. For example it = 7256134 contains the generalized 
pattern 13 — 2 in its subsequence ^27^3^6 = 253. Note that it does not 
contain the pattern 1 — 32, but it contains the classical pattern 132 in the 
subsequences ^27^6 and 7^47^. 

Let 7r be a permutation of S n , then the reverse and complement per- 
mutations 7r r and 7r c , respectively, are defined as follows: 7r[ = 7r n+ i_j and 
irf = n+ 1 — 7Tj, for i = 1, . . . , n. We can define the reverse and the comple- 
ment also for a pattern, regarding the dash as a particular entry in reversing 
7r and leaving it in the same position when the complement ir c is performed. 
So, for example, if p = 1 — 32, then p r = 23—1 and p c = 3 — 12. Considering 
the composition of the reverse and the complement, it is easily seen that 
per _ prc^ rp^g {p ; p r ; p c 5 p cr } i s called the symmetry class of p. Observe 
that \S n (p)\ = \S n (p r )\ = \S n (p c )\ = \S n (p r % ^ 

The twelve generalized patterns of V are organized in three symmetry 
classes : {1 - 23, 32 - 1, 3 - 21, 12 - 3}, {3 - 12, 21 - 3, 1 - 32, 23 - 1} 
and {2 — 13, 31 — 2, 2 — 31, 13 — 2}. If p and p' are two patterns such that 
l<Sn(p)| = \S n (p')\, then p and p' are said to be in the same Wilf class [7]. 
Since in [¥j it is shown that 

• \S n (p)\ = B n , 

for p e {1 - 23, 32 - 1, 3 - 21, 12 - 3} U{3 - 12, 21 -3,1 - 32, 23 - 1} 

• \S n (p)\ = C n , 

for p e {2 - 13, 31 - 2, 2 - 31, 13 - 2}, 

where B n and C n are the n-th Bell and Catalan numbers, respectively, then 
we can say that V is organized in two Wilf classes: {1 — 23, 32 — 1, 3 — 21, 12 — 
3, 3 - 12, 21 - 3, 1 - 32, 23 - 1} and {2 - 13, 31 - 2, 2 - 31, 13 - 2}. 

In this work, we refine some enumerative results on S(p), p G V, namely 
we count p-avoiding permutations, for each p, according to their length and 
the value of their first or last entry. Next we solve the same problem for 
some classes of permutations of the kind S(p, q), p, q £ V, and we conclude 
by proposing to tackle this problem for any remaining pair of generalized 
patterns of V . 

Our results are achieved by using the ECO method together with a 
graphical representation of permutations. In the following we only briefly 
recall the ECO construction for (patterns avoiding) permutations, for more 
details we refer the reader to [2] and [3]. 
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jc = 2 5 3 1 4 ► 71 = 2 6 4 1 5 3 



Figure 1: an ECO construction for permutations 



Any permutation of length n can be visualized using a path-like repre- 
sentation, as in Figure [TJ Note that the plane is divided in n + 1 strips by the 
n horizontal lines which are numerated from 1 to n, starting from bottom (in 
the sequel, we refer to these strips as "regions" : region i is included between 
line i — 1 and line i, whereas region 1 is the one below line 1 and region 
n + 1 is the one above line n). Each entry of the permutation is represented 
as a "node" lying on the line corresponding to its value, . If tt £ S n , then 
n + 1 permutations belonging to S n +i can be obtained by inserting a new 
node in each region of the plane. If we wish to generate the permutations 
in S n +i(P) obtained in such a way from tt £ S n (P), where P is a set of 
forbidden patterns, then the regions the last node can be inserted in form a 
subset of all the n + 1 possible regions; in the framework of the ECO method 
they are called active sites [2] . A remarkable feature of this construction is 
that, if tt £ S n (P), then tt' £ S n +x (which is obtained from tt by inserting 
the last node in one of the regions) does not contain the patterns specified in 
P in its entries tt'j with j = 1, . . . , n, otherwise tt itself would contain some 
pattern of P. So, to decide if a region i is an active site or not, we just have 
to check those generalized patterns the last node is involved in. 

2 The symmetry class {1 - 23, 32 - 1, 3 - 21, 12 - 3} 

2.1 ECO construction and generating tree of S(l — 23) 

Let tt £ S n (l — 23). If ?r n = k ^ 1, then tt generates k permutations 
7i"W £ S n+ \(1 — 23), i = 1, 2, . . . , k, by inserting a new node in region i. If 
TT n = 1, then tt generates n + 1 permutations by inserting a new node in any 
region. Note that in this case the number of sons of tt is determined by the 
length of tt. If 7r( r ) £ S n+ \(1 — 23) denotes the permutation of S n +i(l — 23) 
derived from tt £ S n (l — 23) by inserting the last node in region r, it is easily 
seen that tt^ 1 ) generates, in turns, n + 2 permutations, whereas tt^ v \ r / 1, 
produces r permutations of 5 n+ 2(l — 23). This ECO construction can be 
represented as in Figure [2] and, if we label with (k, n) each permutation of 
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Figure 2: ECO construction of 5(1 - 23) 



S n (l — 23) having k active sites, it can be encoded by the following succession 
rule: 



We now wish to draw the generating tree related the the previous suc- 
cession rule. For the sake of simplicity and for reasons that will become 
clear later, we choose to label the nodes of the generating tree using the 
number of their sons, which correspond to the first element of each label 
of the succession rule. In Figure [3] we have depicted the first levels of the 
generating tree of S(l — 23). Here the labels in bold character correspond 
to the labels of the kind (n + l,n) in the succession rule. Observe that the 
production of each label depends on its level in the generating tree. 



n : 



{ 



(2,1) 

(k, n) ~» (2, n + l)(3,n + 1) • • • (k, n + l)(n + 2, n + 1) 
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Level 

1 2 




3 2 4 2 3 4 




4 252345252352345 

/A A 

5 26 23456 236 



Figure 3: the generating tree of 5(1 — 23) 

2.2 Distribution according to the length and the last value 

Starting from the generating tree of Figure [3l we can consider the matrix 
M = (rriij)i t j>i where m» is the number of labels j + 1 at level i in the 
generating tree: 



M = 
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The above matrix M is called the ECO matrix of the rule O, according 
to [6|. It is easily seen that M can be recursively described as follows: 

1. mi i = 1 (the minimal permutation it = 1 has two sons); 

2- m n ^ = if k > n (each permutation of length n has at most n sons); 

3- m n ^ = Y17=k m n-i,i if k < n (this derives directly from the recursive 
interpretation of the previous succession rule); 

4- m nj „ = m n) i (each permutation of length n — 1 produces precisely one 
son having label 2 and precisely one son having label n + 1). 

Since m n i{= m n ^ n ) is the sum of all the elements in the (n — l)-th 
row (for n > 1), this entry records the total number of (1 — 23)-avoiding 
permutations of length n — 1. In other words, m n) i = B n _\. 



5 



Moreover, from a careful inspection of M, we have that m n> jt_i, with 
k = 2, ... ,n, is the number of permutations of S n (l — 23) ending with k 
and m nt n is the number of permutations of S n (l — 23) ending with 1. Then, 
if we move the diagonal of M such that it becomes the first column of the 
matrix, we obtain a new matrix A = (otj)»J>l where dij is the number of 
(1 — 23)-avoiding permutations of length i ending with j. 



A = 
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The matrix A is essentially the Bell triangle, which can be found in |lUj 
together with several other references. 

The above recursive properties of M can be immediately translated as 
follows: 

1. a\ t i = 1 (the minimal permutation ends, trivially, with 1); 

2. a n ,k = if k > n (each permutation of length n cannot end with a 
number greater than n itself); 

3. a nj fc = Y^i=k a n-i,i + if 2 < A; < n (the diagonal of M has been 
moved in the first column of ^4) ; 

4. a n> i = a n)2 (since a n> i = m n , n = m n ,i = a n>2 ). 
From 3 we obtain, for k > 3: 

Qn,k Q"n,k— 1 Q-n— l,fe— lj 

If we denote by V the usual backward difference operator, since a n> 2 = 
Bn-l, we get: 

n 2 

= V a Hi k-i 

= V k ~ 2 a nt2 = V k ~ 2 B n - 1 (which holds also for k = 2). 

Thus we find the following formulas concerning the distribution of 1 — 23- 
avoiding permutations according to their length and to the value of their last 
entry: 

|{vr E S n (l - 23) : vr n = 1}| = S n _i, n > 1; 
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|{vr G S n (l - 23) : ir n = k}\ = V fc - 2 (£ n _i), 2 < k < n. 

2.3 The other patterns of the class 

The arguments employed for 5(1 — 23) can be easily modified for the 
other patterns of the symmetry class of 1 — 23, obtaining similar results. 
The ECO construction, in these cases, has to be adapted in order to obtain 
the same succession rule and the same generating tree we got for 5(1 — 23). 
The matrices M and A are defined as in the previous section. 

1. For the reverse pattern of 1 — 23, i.e. 32 — 1, we find that Ojj is the 
number of permutations tt of length i such that tt\ = j, and so: 

• |{vr G 5 n (32 - 1) : TT! = 1}| = B n _x, n > 2 ; 

• \{tt G 5 n (32 - 1) : TT! = k}\ = V fe - 2 (£ n _i), 2 < k < n. 

Note that in this case the ECO construction can be, in some way, 
"reversed" , so that the active sites are not on the right of the diagram 
of the permutation tt but on its left, i.e. before the first entry of tt. 

2. For the complement pattern 3 — 21, we have that aj j is the number of 
permutations of length i ending with i + 1 — j: 

• \{tt G 5 n (3 - 21) : 7T n = n}\ = B n _ u n > 1; 

• |{vr G S n (3 - 21) : vr„ = k}\ = V n - fc-1 (S n _i), 1 < k < n - 1. 

3. For the reverse-complement pattern 12 — 3, Oj j is the number of per- 
mutations tt of length i such that tt\ = i + 1 — j, and so: 

• |{vr G 5(12 - 3) : vri = n}\ = n > 1; 

• \{tt g 5(12 - 3) : TTi = k}\ = V^^H-Bn-i), 1 < k < n - 1. 

3 The symmetry class {3 - 12, 21 - 3, 1 - 32, 23 - 1} 

3.1 ECO construction and generating tree of 5(3 — 12) 

Let tt G 5 n (3 — 12). If n n = k — 1 ^ n, then tt generates k permutations 
7rM G 5 n+ i(3 — 12), i = 1, 2, . . . , k — 1, n + 1, by inserting a new node in 
region i. If tt u = n, then tt generates n + 1 permutations by inserting a 
new node in any region. As it happened for the class 5(1 — 23), note that 
the number of sons of tt is determined by the length of tt. It is easily seen 
that 7r( n+1 ) generates, in turns, n + 2 permutations, whereas tt^ (j / n+1) 
produces i + 1 permutations. This ECO construction is illustrated in Figure 
HI If each permutation of 5 n (3 — 12) with k active sites is labelled (k,n), 
then such a construction can be encoded using the following succession rule: 

f (2,1) 

\ (k, n) ~* (2, n + 1)(3, n + 1) • • • (k, n + l)(n + 2,n + 1) . 
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(2, 2) 




O 



Figure 4: ECO construction of 5(3 - 12) 

Since it is the same succession rule we got for 5(1 — 23), the generating 
tree for 5(3 — 12) can be obtained in the same way. 

3.2 Distribution according to the length and the last value 

Defining the matrix M = (piij)ij>i as in Section 12.21 it can be easily 
deduced that m n ^ is the number of permutations of 5 n (3 — 12) ending with 
k. Note that in this case we do not need to move the diagonal of M to obtain 
the final matrix. Therefore, using again the backward difference operator 
V, the entries of M have the form: 

"Vfc = V fc-1 (5„_i) 

whence: 

|{vr E 5 n (3 - 12) : n n = n}\ = B n _ u n>2; 
\{ir G 5 n (3 - 12) : vr n = fc}| = V^^n-l), 1 < k < n - 1 . 
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3.3 The other patterns of the class 
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in Section f2,3l 
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4 The symmetry class {2 - 13, 31-2,2- 31, 13 - 2} 

The permutations of S(2 — 13) are enumerated by Catalan numbers 
As far as the ECO construction of S(2 — 13) is concerned, we just note that, 
if 7r G S n (2 — 13) is such that 7r n = k, then region i, for i = 1, 2, . . . , k + 1, 
is an active site for 7r. The succession rule encoding this construction is: 

/ (2) 

1 (A0-(2)(3)...(fc + l) 
Defining the matrix M as in the preceding sections, we obtain 
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which is the well-known Catalan Triangle whose entries rriij = f( 2i j^ 1 X ) 
are the ballot numbers and whose properties can be found, for example, in 

In the following, we present the results for all the patterns of the class, 
which can be derived as in the previous sections (the m nj fc's are defined as 
before): 

. |{tt G S n (2 - 13) : vr n = k}\ = m n , fc = K^f 1 ) ; 
. |{tt G 5„(31 - 2) : tt! = fc}| = m n , fc = ^nY) ! 
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. \{n G S n (2 - 31) : ir n = k}\ = m n , n _ fc+1 = *=&± ( n + fe ~ 2 ) ; 
• |{vr G 5 n (13 - 2) : TTi = fe}| = m n , n _ fc+1 = 2=*±± ( n ^ 2 ) . 

5 Permutations avoiding a pair of generalized pat- 
terns of type (1,2) or (2,1) 

In [5] Claesson and Mansour counted permutations avoiding a pair of 
generalized patterns of type (1,2) or (2,1). Similarly to what we have done in 
the previous sections, we can study the distribution of the statistic "first/last 
entry" on permutations avoiding two or more generalized patterns. Here, 
we consider only two special examples, the former being quite easy, whereas 
the latter is surely more interesting. All the remaining cases are left to the 
readers as open problems for future research. 

5.1 An easy case 

We first deal with the permutations of S(l — 23, 1 — 32). This class 
is enumerated by the number I n of involutions in S n (see [5]). An ECO 
construction of this class can be encoded by the following succession rule : 

f (2,1) 

Q : i (l,n) -w (n + 2,n+ 1) 

{ (n + l,n) -w (l,ra + l) n (n + 2,n + 1) 

where the first element in the label is the number of active sites of the permu- 
tation and the second one is its length. This can be checked by representing 
permutations by means of the usual path-like representation: indeed, if a 
permutation ends with 1, then an element can be inserted on its right in any 
region, whereas if a permutation ends with k ^ 1, then the only element 
which can be inserted must be placed in region 1 on the right. The reader 
is invited to complete the details, so to obtain the construction described 
precisely by the succession rule Q. 

From the generating tree of f2, the matrix M whose entry rriij is the 
number of vertices with label j at level i > 1) can be constructed as in 
the preceding cases: 
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o o o o o : 

o o o o o : 

2 0ooo: 

4 0: 

o o 10 o o : 

o o 26 o : 

o o o o 76 : 

The entries can be immediately computed as follows: 

• 7711,1 = , 1711,2 = 1 ; 

• m n ,i = (n - l)m n _i >n , n > 2 ; 

• rn n>n+ x = %-y + m n _i jn , n > 2 ; 

• 77i j j = in all the other cases. 

From the ECO construction it easily appears that the first column of M 
counts the permutations it of S n (l — 23, 1 — 32) such that 7r n _i = 1 (or, which 
is the same, 7r n ^ 1), whereas the super-diagonal sequence m nin+ i (n > 1) 
shows the number of 7r ending with 1. Since if ir £ 5 n (l — 23, 1 — 32), then 
7r n _i = 1 or 7r n = 1, we deduce that the super-diagonal satisfies m n)n+ i = 
In-l (n> 1). 
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5.2 A not so easy case 

Our second example concerns the permutations of the class 5(1 — 23, 21 — 
3), which also coincide with those of 5(1 — 23,21 — 3, 12 — 3)(see [3]) and 
are enumerated by Motzkin numbers. We will find the distribution of these 
permutations according to their length and their last entry; moreover, we 
will be able to derive the generating function of the sequences enumerating 

the permutations of this class whose last entry is k, for k = 1, 2, We start 

by recalling the coloured succession rule <3? encoding an ECO construction 
for the above set of permutations (which can be found in [3]): 



$ : <^ 



(2) 

(fc)-»(2)(2)(3)-(fc) 



[ (A0~»(2)(3)..-(fc)(fc + l) . 

In Figure \5\ the first levels of the corresponding generating tree are pre- 
sented. 
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222 3 23 22 3 

A A AAA A A A A 

222323223232232223234 

Figure 5: the generating tree of 5(1 — 23, 21 — 3) 

As in the preceding examples, we construct a matrix A = (flij)ij>\ 
recording in its entries the number of labels at each level of the tree: namely, 
a^i is the number of coloured label k, k > 2, at level i of the tree and anj, 
j > 2, is the number of labels j at level i. The first lines of A are: 
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As usual, we can find a recursive description of the entries of A: 

• each label at level i—1 produces, among its sons, precisely one coloured 
label at level i, and so: 

= ^2 Oi-i,r ; 

• each label j > 2 at level i is generated either by a label k > j at level 
i — 1 or by a coloured label k, with k > j at level i — which, in turn, 
is generated by the label k — 1 at level i — 2, then: 

a i,j = a i-l,k + ^ a-i-2,k for j>2; (1) 
k>j k>j—l 
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it is easily seen that, in the above generating tree, the coloured label k 
first appears at the odd level 2k — 3, whereas the label k first appears 
at the even level 2k — 2, whence: 



for j > [i/2\ +2 



The ECO construction of S(l — 23, 21 — 3) shows that, if a permutation 
has label k, then it ends with k, while if it has a coloured label k, then its 
last entry is 1. Therefore, the entry a^j is the number of permutations with 
length i and ending with the element j. 

Our next aim is to find the generating function for the sequences displayed 
in the columns of the matrix A, which are the sequences enumerating the 
permutations of 5(1 — 23, 21 — 3) with last entry j = 1,2,..., according to 
their length. It is convenient to change a little bit the notation: from now 
on, we will index the lines of A starting from instead of 1. First of all, we 
derive a simple recurrence for the entries of A: using (pQ), simple calculations 
show that 

a n ,k = a n ,k-i - a n _i,fc_i - a n ^ 2 ,k-2 , for k > 2 , n > . (2) 
Let C k {x) be the generating function of the k-th column of A: 

Ck{x) = ^Cln^X 71 . 
n>0 

Using ([2]), we find the following recurrence relation for C k {x): 

C k+2 {x) = (1 - x)C k+1 (x) - x 2 C k (x), k>0. (3) 

From the succession rule $ (or from the ECO construction for S(l — 23, 21 — 
3)), it is easy to check that 

Cq{x) = M{x), Ci(a?) = M(x) - 1 , 

where 

„ ,. , 1 — x — \fl — 2x — 3x 2 
= ^ 

is the generating function of Motzkin numbers {M n }„>o. In order to find a 
closed form for C k (x), we define a linear operator L on the vector space V 
of formal power series of odd order. The set {C k (x)) k >\ is a basis of V, so 
L can be defined as follows: 

L{C k {x)) = C k+1 {x) for k>l. (4) 

From © it is: 

L\C k (x)) = (1 - x)L(C k (x)) - x 2 C k (x) 
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which is the same of 

(L 2 - (1 - x)L + x 2 )C k (x) = . 

Therefore the operator L 2 — (1 — x)L + x 2 must vanish on V. Solving the 
equation I? — (1 — x)L + x 2 = 0, leads to 



1 — x — vl — 2x — 3x 2 n,,, . 
L = — = x 2 M(x) . 

Now, from (j3J), we obtain the desired closed form for Cfc(x): 

C k (x) = x 2 M(x)C fc _i(x) = ■■■ = x 2{k ~ l ^M k - 1 {x){M{x) - 1), k > 1 . 
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